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AUDIO DIGITAL WATERMARK APPARATUS 
BACKGROUND OF THE INVENTION 

5 Field of the Invention 

The present invention relates to an apparatus which embeds information such as 
copyright identification data as a digital watermark to audio data, and to an apparatus which 
detects and decrypts the digital watermark from the audio data, in which the digital 
watermark has been embedded. 

10 

Description of the Related Art 

There exist many technologies for embedding watermarks in audio data such as music. 
However, in general, it is difficult to strike a balance between the sound quality and 
durability of a watermark. For example, in cases where watermark data is represented by 

15 some lower bits of sample data of audio data, noise will not be noticeable. However, if this 
information is represented as a high-frequency component in frequency conversion, it can 
easily be removed by compressing with compression software such as MP3. Moreover, there 
is a digital watermark, which is specific to MP3 compression from the beginning, such as a 
watermark in which coding is performed by using parity of a quantized frequency component. 

20 However, in many cases, the watermark information disappears in re-compression with a 
different data compression ratio. Further, there is a method of embedding watermark data by 
focusing on a compression method without degradation of sound quality. However, if it is 
converted into wave data, watermark information disappears. Besides, for example, there is a 
method of using statistical bias, etc. However, the more the number of samples for 

25 representing one bit in order to improve resistance of a watermark, the less data amount can 
be embedded. Meanwhile, the larger the bias becomes, the more resistant the watermark data 
becomes. However, the larger the bias becomes, the greater the degradation. 

Thus, there has been no ideal digital watermark technology in which watermark data 
can be embedded without degradation of sound quality of original audio data, and the 
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watermark data remains in spite of modification by irreversible data compression, etc., 
resulting in easy diction of the watermark data. 

(The list of cited patent documents) 
5 Japanese Publication No. 2002-304 1 84 

In recent years, digitalization has proliferated, so that anyone can easily produce an 
exact copy of original audio data. Moreover, there have been many cases in which the data is 
compressed by compression software such as MP3 (MPEG Audio Layer 3), and distributed 

1 0 via the internet. 

Such an act is less problematic with personal use, in which the user legally purchases 
the audio data and uses it personally; however, with illegal copying and distribution, it 
becomes a problem because it is difficult for a copyright holder to collect copyright royalty 
under such circumstances, thereby curtailing creative motivation. 

15 In order to protect copyright from such fraudulent acts, there is a real need for a 

technology capable of embedding copyright information such as a watermark into the 
respective audio data. 

SUMMARY OF THE INVENTION 

20 The first embodiment of the invention relates to an audio digital watermark apparatus for 
recording watermark data on a voice recording medium, which comprises: 

an audio data acquisition unit, which acquires audio data; 

a watermark data acquisition unit, which acquires watermark data; 

a data generation unit for generating data for a watermark, which generates data for a 
25 watermark by multiplexing the audio data acquired by said audio data acquisition unit and 
the data for generating a watermark generated by said data generation unit for generating 
data for a watermark, wherein the result of a predetermined summation of multiplexed audio 
data per predetermined cycle represents the watermark data acquired by said watermark data 
acquisition unit; and 
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a multiplexed audio data generation unit, which generates multiplexed audio data by 
multiplexing the audio data acquired by said audio data acquisition unit and the data for 
generating a watermark generated by said data generation unit for generating data for a 
watermark. 

5 The second embodiment of the invention relates to an audio digital watermark 

apparatus according to Claim 1, wherein said data generation unit for generating data for a 
watermark generates the data for a watermark of inaudible low frequency. 

The third embodiment of the invention relates to an audio digital watermark apparatus 
according to Claim 1 or 2, wherein said data generation unit for generating data for a 
10 watermark generates the data for a watermark, in which the value and the slope of the 
boundary for changing the amplitude of a function of the data for generating a watermark, 
which is- generated by the data generation unit for generating data for a watermark; are 
always zero. 

The fourth embodiment of the invention relates to an audio digital watermark 
15 apparatus according to any one of Claims 1 to 3, wherein said data generation unit for 
generating data for a watermark changes the amplitude of a function represented by said data 
for generating a watermark with respect to each half-cycle so that said result of the 
predetermined summation per said predetermined cycle represents the watermark data 
acquired by said watermark data acquisition unit. 
20 The fifth embodiment of the invention relates to an audio digital watermark apparatus 

according to any one of Claims 1 to 4, wherein said result of the predetermined summation 
per said predetermined cycle is a sign for the summation of said multiplexed audio data per 
half-cycle of said data for generating a watermark. 

The sixth embodiment of the invention relates to an audio digital watermark 
25 apparatus according to any one of Claims 1 to 4, wherein said result of the predetermined 
summation per said predetermined cycle is a sign representing the difference of the 
summation of said multiplexed audio data corresponding to the first half of the cycle and that 
of the latter half of said data for generating a watermark. 

The seventh embodiment of the invention relates to an audio digital watermark 
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decoding apparatus for decoding a watermark data recorded on an audio recording medium, 
which comprises: 

a multiplexed audio data acquisition unit, which acquires multiplexed audio-data, - - 
a summation computation unit, which computes the result of a predetermined 
5 summation of multiplexed audio data per said predetermined cycle, wherein said multiplexed 
audio data is acquired by the multiplexed audio data acquisition unit, and 

a watermark data decoding unit, which decodes said watermark data based on said 
result of a predetermined summation computed by said summation computation unit. 

The eighth embodiment of the invention relates to an audio digital watermark 
10 decoding apparatus according to Claim 7, wherein said summation computation unit 
computes a sign for summation of said multiplexed audio data over a period of a half-cycle 
... of said data for "generating a watermark, in which said multiplexed audio data is acquired:by * *. 
the multiplexed audio data acquisition unit. V : > 

The ninth embodiment of the invention relates to an audio digital watermark decoding 
1 5 apparatus according to Claim 7, wherein said summation computation unit computes a sign of 
the difference between the summation of said multiplexed audio data over a period of a 
half-cycle, the first half of one cycle, and a summation of said multiplexed audio data over a 
period of a half-cycle, the latter half thereof, in which said multiplexed audio data is 
acquired by said multiplexed audio data acquisition unit. 

20 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a functional block diagram of the first embodiment of the present invention. 
Fig. 2 is an illustration of a waveform pattern of audio data which is acquired in the 
first embodiment. 

25 Fig. 3 is an illustration of a waveform pattern of a base function of data for generating 

a watermark which is generated in the first embodiment. 

Fig. 4 is an illustration of a sampling pattern of a base function of data for generating 
a watermark which is generated in the first embodiment. 

Fig. 5 is an illustration of a waveform pattern of a data for generating a watermark of 



character "C" which is generated in the first embodiment. 

Fig. 6 is an illustration of a process of embedding a watermark in the first 
embodiment. 

Fig. 7 is an illustration of a process of the first embodiment. 

Fig. 8 is a functional block diagram of the eighth embodiment of the present 
invention. 

Fig. 9 is an illustration of a process of the second embodiment. 

Fig. 10 is a functional block diagram of the tenth embodiment of the present 
invention. 

Fig. 11 is an illustration of a waveform pattern of a base function of data for 
generating a watermark which is generated in the third embodiment. 

Fig. 12 is an illustration of a process of the third embodiment. 

Fig. 13 is a functional block diagram of the thirteenth embodiment of the present 
invention. 

Fig. 14 is an illustration of a waveform pattern of a base function of data for 
generating a watermark which is generated in the fourth embodiment. 

Fig. 15 is an illustration of a sampling pattern of a base function of data for 
generating a watermark which is generated in the fourth embodiment. 

Fig. 16 is an illustration of a waveform pattern of a data for generating a watermark 
of character "C" which is generated in the fourth embodiment. 

Fig. 17 is an illustration of a process of the fourth embodiment. 

Fig. 18 is a functional block diagram of the eighteenth embodiment of the present 
invention. 

Fig. 19 is an illustration of a process of embedding a watermark in the fifth 
embodiment. 

Fig. 20 is an illustration of a process of the fifth embodiment. 

Fig. 21 is a functional block diagram of the twenty-first embodiment of the present 
invention. 

Fig. 22 is an illustration of a process of the sixth embodiment. 
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Fig. 23 is a functional block diagram of the twenty-third embodiment of the present 
invention. 

Fig. 24 is an illustration of a process of detecting a watermark in the seventh 
embodiment. 

5 Fig. 25 is an illustration of a process of the seventh embodiment. 

Fig. 26 is a functional block diagram of the twenty-sixth embodiment of the present 
invention. 

Fig. 27 is an illustration of a process of detecting a watermark in the eighth 
embodiment. 

10 Fig. 28 is an illustration of a process of the eighth embodiment. 

Fig. 29 is a functional block diagram of the twenty-ninth embodiment of the present 
invention. 

Fig. 30 is an illustration of a. process of detecting, a watermark in the .ninth i f » 

embodiment. 

15 Fig. 31 is an illustration of a process of the ninth embodiment. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

Hereinafter, the embodiments of the present invention will be described. The 
relationships between the embodiments and Claims are as indicated below. 
20 In the first embodiment, Claims 1 and 10 will be mainly described. 

In the first embodiment, Claims 2 and 1 1 will be mainly described. 

In the first embodiment, Claims 3 and 12 will be mainly described. 

In the first embodiment, Claims 4 and 13 will be mainly described. 

In the first embodiment, Claims 5 and 14 will be mainly described. 
25 In the first embodiment, Claims 6 and 15 will be mainly described. 

In the first embodiment, Claims 7 and 16 will be mainly described. 

In the first embodiment, Claims 8 and 17 will be mainly described. 

In the first embodiment, Claims 9 and 18 will be mainly described. 
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(The first Embodiment) 

The invention described in the first embodiment relates to an audio digital watermark 
apparatus which embeds watermark data such as copyright information by acquiring the 
copyright information as the watermark data, by multiplexing with audio data, and by using 
5 the result of a predetermined summation per predetermined cycle. 

As shown in Fig. 1, the audio digital watermark apparatus 0100 of the first 
embodiment of the present invention comprises an audio data acquisition unit 0101, a 
watermark data acquisition unit 0102, a data generation unit for generating data for the 
10 watermark 0103, and a multiplexed audio data generation unit 0104. 

(Audio data acquisition unit) 

An audio data acquisition unit acquires audio data. 

(Watermark data acquisition unit) i 
A watermark data acquisition unit acquires watermark data. Here, "watermark data" 
1 5 corresponds to the codes such as copyright identification information or digital data such as 
an ID used in content distribution. 

(Data generation unit for generating data for a watermark) 

A data generation unit for generating data for a watermark which generates data for a 
watermark by multiplexing the audio data acquired by said audio data acquisition unit and 
20 the data for generating a watermark generated by said data generation unit for generating 
data for a watermark, wherein the result of a predetermined summation of multiplexed audio 
data per predetermined cycle represents the watermark data acquired by said watermark data 
acquisition unit. 

Here, the "result of predetermined summation of multiplexed audio data per 
25 predetermined cycle" corresponds to the result of a predetermined summation of data for 
generating a watermark of multiplexed audio data per predetermined cycle. The 
"predetermined cycle" corresponds to a half-cycle, 1 -cycle, 1.5-cycle, 2-cycle, 2.5-cycle, 
3-cycle, and so on. The "predetermined summation" corresponds to the summation of a 
half-cycle and summation of one cycle etc. The "result of predetermined summation" 
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corresponds to summation per half-cycle and per 1 cycle, a sign for summation, and a sign 
representing the difference between summations, etc. 
(Multiplexed audio data generation unit) 

A multiplexed audio data generation unit generates multiplexed audio data by 
multiplexing the audio data acquired by said audio data acquisition unit and the data for 
generating a watermark generated by said data generation unit for generating data for a 
watermark. 

Hereinafter, the first embodiment of the present invention will be described by using 
concrete examples. 

(Acquisition of audio data) 

Audio data having a waveform as shown in Fig. 2 is acquired. 

Note that digitalized audio data such as PCM (Pulse Code Modulation) may be* 
acquired. Moreover, an analog waveform may be acquired and converted to digital data by 
sampling/quantization. Further, compressed audio data may be extracted as PCM data by 
decoding. 

(Acquisition of watermark data) 

Next, the watermark data may be any type of digital information such as codes and 
strings indicating copyright information, which are represented by binary numbers. For 
example, in cases where a string of letters is embedded without being compressed, it is 
converted to ASCII code and the value thereof is represented by a binary number. 

Here, as an example, a case in which character "C" of "Copyright" is acquired as 
watermark data, will be described. The AACII code of this character is represented by a 
binary number such as "0100001 1". 

(Data for generating a watermark: generation of a base function) 

Next, a generation method of data for generating a watermark will be described. The 
watermark data is represented by a function in which a function of a basis (Hereinafter, 
referred to as a base function.) is multiplied by the amplitude A. 

For example, below is described a case in which the sampling rate of audio data is R Hz, and 
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the wave of f Hz is used. Here, f is a set so that R/f is an integral number. 

The base function u(t) is a function in which the above wave is sampled by sampling 

rate R. (Actually, sampling is not carried out, but derived by using a formula.) Here, t is a 

sample point. Fig. 3 illustrates an example of base function u(t), in which a sine-wave of 
5 cycle R/f is moved upward to adjust the maximum value to one and the minimum value to 0. 

Since the above value of the function u(t) is frequently used, the value per one cycle 
is computed and a list of function values is pre-stored in memory. 

Therefore, "u(0),u(l ),..., u(R/f-l)" are stored in the memory. 

As shown in Fig. 4, a value at sample point t of the i-th cycle can be derived from said 
10 value per one cycle by using the following formula: u(t)=u (t-(i-l)-R/f). 



(Data for generating a watermark: computation of summation) 

The multiplexed audio data is generated by multiplexing said data for generating^ 
watermark and original audio data. If a sample value of the original audio data is v(t), the 
15 multiplexed audio data becomes as below: 

(1) a(0)-u(0)+v(0), 

(2) a(R/f)-u(R/f>v(R/f), 

(3 ) a(2 • R/f- 1 ) ■ u(2 • R/f- 1 )+v(2 • R/f- 1 ), 

(4) a(2-R/f)-u(2-R/f)+v(2-R/f), and 
20 (5) a(3-R/f-l)-u(3-R/f-l)+v(3-R/f-l). 



If a sample value of the multiplexed audio data, which has been multiplexed with the 
data for generating a watermark, at the sample point t is w(t), the above example can be 
represented by the following formula: w(t)=v(t)+a(t)-u(t). 

25 

The above w(t) is added over one cycle of the i-th cycle. Here, a(t) is a certain value in 
one cycle. If this value is aj, then Ew(t)=£v(t)+aj-Eu(t). 



Here, E represents a summation per one cycle of the i-th cycle of data for generating a 
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watermark. 

Moreover, in the description hereinafter, the following formulae are formed: 
Vi=Ev(t), and U=Du(t) 

5 

Generally, Vj changes with respect to each i cycle, meanwhile, U is a constant. Also, 
the constant, U, is pre-stored in the memory. 

(Data for generating a watermark: generation of amplitude) 
1 0 Next, the value of aj is set so that the absolute value of summation of the multiplexed 

audio data is a fixed value, and a sign thereof represents the bit-value of the watermark data. 
If the bit-value is b(0 or 1), and the absolute value of summation of the multiplexed audio ^ 
dataisS, and(-l) b -S=Vi+ai-U 

15 Therefore, the following formula is formed: ai={(-l) b - S-Vj}/U 

Note that, in this example, one cycle represents one bit, so that the value of b changes 
as per i. 

20 (Generation of data for generating a watermark) 

A function representing the data for generating a watermark, which is derived by 
multiplying the base function of the data for generating a watermark with amplitude aj, is: 
{(-l) b -S-Vj}-u(t)/U 

25 A schematic view of a waveform of the data for generating a watermark 

corresponding to character "C" of the watermark data is illustrated in Fig. 5. Note that, in Fig. 
5, although the sign of amplitude a { and the sign of (-l) b are identical, they may be reversible 
according to the size of Vj. The bit-value is represented not by the sign of amplitude of the 
data for generating a watermark, but by the sign of the summation of the multiplexed audio 
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data. 

(Generation of multiplexed audio data) 

Therefore, a relationship between the data for generating a watermark and the 
multiplexed audio data w(t) is: w(t)=v(t)+{(-l) b - S-Vj} -u(t)/U 

5 

(Process of embedding a digital watermark) 

Next, by using the above formula, the process of embedding a digital watermark into 
audio data will be described with reference to Fig. 6. First, the audio data per one period of 
the data for generating the watermark is inputted to A02, and the summation of the above 

10 formula is computed and outputted to A03. Meanwhile, the watermark data is inputted to A02, 
and a sign of (-l) b of the above formula is outputted to A03 per cycle of the data for 
generating a watermark. Therefore, in cases where the bit-value, is 0, "+" sign is outputted, 
and in cases where the bit-value is 1, "-" sign is outputted. In A03, by using these two values, 
the data for generating a watermark is generated according to the above formula, and 

15 outputted to A04. In A04, by multiplexing this data for generating a watermark and the 
original audio data, multiplexed audio data with a watermark data is generated and outputted. 
(Other features) 

The above process of embedding a watermark is reversible, so that it is possible to 
perfectly recover it if there is time-series data of amplitude of the data for generating a 

20 watermark which has been used in embedding the watermark data. Moreover, even if after 
watermark data has been embedded, or the other watermark data is embedded by the other, it 
is possible to extract each watermark data and recover the original audio data. Thus, it is able 
to embed a watermark several times over. Therefore, for example, it becomes possible to 
embed a unique ID of a content provider for the purpose of preventing fraudulent secondary 

25 distribution while protecting the copyright thereof after a copyright holder embeds 
information on the copyright. 

Moreover, it is impossible to recover the original state of the data without the 
time-series data of amplitude of the data for generating a watermark which has been used in 
embedding the watermark data (since the bit-value is represented by the summation of 
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multiplexed audio data, a method of decomposition to the original audio data and the data for 
generating a watermark is non-unique.). Therefore, by using the above aspect of the present 
invention, it is possible to establish a digital watermark system, which is highly resistant to 
falsification. For example, the above time-series data is outputted at the point of embedding 
the watermark data, and is stored in a place for managing the copyright. A person, who 
asserts the copyright of the audio data, brings the original audio data without a watermark, 
which is in his possession (asserted as such) to the place at which the copyright is 
administered, and composites said original audio data by using the time-series data of the 
amplitude of said data for generating a watermark. If the composite data is identical to the 
multiplexed data with the watermark, which has been distributed, it is authenticated as 
original data. 

Note that although a description about the detection of the starting point of a 
watermark data or the error processing, etc. has not been described hereinabove, it is easy to 
implement them by using well-known prior art. For example, with regard to the detection of 
the starting point of the watermark data is implemented by pre-inserting a specific bit-pattern 
before the watermark data, and decoding immediately after that pattern is detected. In fact, 
there is a method wherein a point having 0 amplitude is skipped unconditionally, and a point 
synchronizing with a start-code is detected by moving the starting point by increments, after 
that, decoding is carried out by one cycle of the watermark data sequentially. With regard to 
the error processing, there is a method wherein a checksum, etc. are embedded as watermark 
data, and they are checked at the point of decoding. 

In Fig. 7, the process of the first embodiment is illustrated. 

First, an audio data acquisition unit acquires audio data (Step S0701). 

Second, a watermark data acquisition unit acquires watermark data (Step S0702). 

Third, a data generation unit for generating data for a watermark generates data for a 
watermark (Step S0703) by multiplexing the audio data acquired by Step S0701 and the data 
for generating a watermark generated by Step S0702, wherein the result of a predetermined 
summation of multiplexed audio data per predetermined cycle represents the watermark data 
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acquired by Step S0702. 

Fourth, a multiplexed audio data generation unit generates multiplexed audio data 
(Step S0704) by multiplexing the audio data acquired by Step S0701 and the data for 
generating a watermark generated by Step S0703. 

According to the first embodiment of the present invention, it becomes possible to 
prevent degradation of sound quality in embedding a watermark data by using a method 
wherein copyright information, etc. are acquired as watermark data and multiplexed with the 
audio data to be multiplexed audio data, so that the watermark information is represented by 
the result of a predetermined summation per predetermined cycle. 

Moreover, since one bit is encoded at one wavelength of data for generating a 
watermark, if the data for generating a watermark has a long wavelength, it becomes possible 
to embed a large amount of watermark data effectively. 

(The second embodiment) 

The second embodiment of the present invention relates to the audio digital 
watermark apparatus according to Claim 1, wherein said data generation unit for generating 
data for a watermark generates the data for a watermark of inaudible low frequency. 

As shown in Fig. 8, the audio digital watermark apparatus 0800 of the second 
embodiment of the present invention comprises an audio data acquisition unit 0801, a 
watermark data acquisition unit 0802, a data generation unit for generating data for a 
watermark 0803, and a multiplexed audio data generation unit 0804. 

(Audio data acquisition unit) 

The audio data acquisition unit is the same as the audio data acquisition unit in the 
first embodiment of the present invention, so that the description thereof is omitted. 
(Watermark data acquisition unit) 

The watermark data acquisition unit is the same as the (Watermark data acquisition 
unit) in the first embodiment of the present invention, so that the description thereof is 
omitted. 
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(Data generation unit for generating data for a watermark) 

The data generation unit for generating data for a watermark generates the data for a 
watermark of inaudible low frequency. Here, " inaudible low frequency" corresponds to a 
low frequency below 20Hz. 

The other features are the same as the data generation unit for generating data for a 
watermark in the first embodiment of the present invention, so that the description thereof is 
omitted. 

(Multiplexed audio data generation unit) 

The multiplexed audio data generation unit is the same as the multiplexed audio data 
generation unit) in the first embodiment of the present invention, so that the description 
thereof is omitted. 

Hereinafter, the second embodiment of the present invention will be described by 
using concrete examples. 

(Acquisition of audio data) 

Acquisition of audio data is the same as the acquisition of audio data in the first 
embodiment of the present invention, so that the description thereof is omitted. 
(Acquisition of watermark data) 

Acquisition of watermark data is the same as the acquisition of watermark data in the 
first embodiment of the present invention, so that the description thereof is omitted. 
(Data for generating a watermark: generation of base function) 

In the second embodiment of the present invention, inaudible low frequency is used 
for the data for generating a watermark. In an example, the sampling-rate is 44.1 kHz, a 
function of 10 Hz is used as data for generating a watermark, and the base function u(t) is a 
function of which cycle is 44.1 kHz/10. 

In the second embodiment, R = 44.1 kHz, f = 10 (R and f are defined in the first 
embodiment.) The other features are the same as the data for generating a watermark 
(generation of a base function) in the first embodiment of the present invention, so that the 
description thereof is omitted. 
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(Data for generating a watermark: computation of summation) 

In the second embodiment, R = 44.1 kHz, f = 10 (R and f are defined in the first 
embodiment.) The other features are the same as the data for generating a watermark: 
computation of summation in the first embodiment of the present invention, so that the 
description thereof is omitted. 

(Data for generating a watermark: generation of amplitude) 

In the second embodiment, R - 44.1 kHz, f = 10 (R and f are defined in the first 
embodiment.) The other features are the same as the data for generating a watermark: 
generation of amplitude in the first embodiment of the present invention, so that the 
description thereof is omitted. 

(Generation of data for generating a watermark) 

In the second embodiment, R = 44.1 kHz, f = 10 (R and f are defined in the first 
embodiment.) The other features are the same as the generation of data for generating a : # 
watermark in the first embodiment of the present invention, so that the description thereof is 
omitted. 

(Generation of multiplexed audio data) 

Generation of multiplexed audio data in the second embodiment of the present 
invention is the same as the generation of multiplexed audio data in the first embodiment of 
the present invention, so that the description thereof is omitted. 

(Process of embedding a digital watermark) 

Process of embedding a digital watermark in the second embodiment of the present 
invention is the same as the process of embedding a digital watermark in the first 
embodiment of the present invention, so that the description thereof is omitted. 

(Other features) 

The other features in the second embodiment of the present invention are the same as 
the other features in the first embodiment of the present invention, so that the description 
thereof is omitted. 

In Fig. 9, the process of the second embodiment is illustrated. 
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First, an audio data acquisition unit acquires audio data (Step S0901). 
Second, a watermark data acquisition unit acquires watermark data (Step S0902). 

~ Third, a data generation-unit for genera ting data for a watermark generates data for a 
watermark of inaudible low-frequency (Step S0903) by multiplexing the audio data acquired 
5 by Step S0901 and the data for generating a watermark generated by Step S0902, wherein the 
result of a predetermined summation of multiplexed audio data per predetermined cycle 
represents the watermark data acquired by Step S0902. 

Fourth, a multiplexed audio data generation unit generates multiplexed audio data 
(Step S0904) by multiplexing the audio data acquired by Step S0901 and the data for 
10 generating a watermark generated by Step S0903. 

According to the second embodiment of the present invention, since the data of " 
inaudible low-frequency is used as data for generating a watermark, even if the amplitude of 
data for generating a watermark is wide, it becomes possible to implement a robust digital 
1 5 watermark without degradation of sound quality of the original audio data. 

Moreover, since one bit is encoded at one wavelength of data for generating a 
watermark, if the data for generating a watermark has a long wavelength, it becomes possible 
to embed a large amount of watermark data effectively. 

20 (The third embodiment) 

The third embodiment of the present invention relates to the audio digital watermark 
apparatus according to Claim 1 or 2, wherein a function, in which a value and a slope of a 
boundary for changing an amplitude thereof are always zero, is used as a function 
representing data for generating a watermark. 
25 As shown in Fig. 10, the audio digital watermark apparatus 1000 of the third 

embodiment of the present invention comprises an audio data acquisition unit 1001, a 
watermark data acquisition unit 1002, a data generation unit for generating data for a 
watermark 1003, and a multiplexed audio data generation unit 1004. 

(Audio data acquisition unit) 
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The audio data acquisition unit is the same as the audio data acquisition unit in the 
first or second embodiment of the present invention, so that the description thereof is 
omitted. 

(Watermark data acquisition unit) 
5 The watermark data acquisition unit is the same as the watermark data acquisition 

unit in the first or second embodiment of the present invention, so that the description 
thereof is omitted. 

(Data generation unit for generating data for a watermark) 

The data generation unit for generating data for a watermark generates the data for a 
1 0 watermark, in which the value and the slope of the boundary for changing the amplitude of a 
function of the data for generating a watermark, which is generated by the data generation 
unit for generating data for a watermark, are always zero. 

The other features are the same as the data generation unit for generating data for a^ 
watermark in the first or second embodiment of the present invention, so that the description 
1 5 thereof is omitted. 

(Multiplexed audio data generation unit) 

The multiplexed audio data generation unit is the same as the multiplexed audio data 
generation unit in the first or second embodiment of the present invention, so that the 
description thereof is omitted. 

20 

Hereinafter, the third embodiment of the present invention will be described by using 
concrete examples. 

(Acquisition of audio data) 

Acquisition of audio data is the same as the acquisition of audio data in the first or 
25 second embodiment of the present invention, so that the description thereof is omitted. 
(Acquisition of watermark data) 

Acquisition of watermark data is the same as the acquisition of watermark data in the 
first or second embodiment of the present invention, so that the description thereof is 
omitted. 
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(Data for generating a watermark: generation of base function) 

In the third embodiment of the present invention, a function, in which the value and 
the slope of the boundary for changing the amplitude thereof are always zero, is used as a 
function representing data for generating a watermark. Therefore, the following function, in 
5 which the value and the slope of the boundary for changing the amplitude thereof are zero, is 
used as the base function u(x) of the data for generating a watermark: u(x n )=u'(x n )=0 

Here, x„ is the n-th boundary point for changing said amplitude. In Fig. 1 1, a case in 
which x n =n'7r(n is an integral number) is illustrated. 
10 The other features are the same as the (Data for generating a watermark: generation of 

base function) in the first or second embodiment of the present invention, so that the 
description thereof is omitted. 

(Data for generating a watermark: computation of summation) 

In the third embodiment, the base function u(x) fulfills conditions of (Data for 
15 generating a watermark: generation of base function). 

The other features are the same as those of the data for generating a watermark 
(computation of summation) in the first or second embodiment of the present invention, so 
that the description thereof is omitted. 

(Data for generating a watermark: generation of amplitude) 
20 In the third embodiment, the base function, u(x), fulfills the conditions of the data for 

generating a watermark (generation of base function). 

The other features are the same as those of the data for generating a watermark 
(generation of amplitude) in the first embodiment of the present invention, so that the 
description thereof is omitted. 
25 (Generation of data for generating a watermark) 

Generation of data for generating a watermark in the third embodiment of the 
present invention is the same as the generation of data for generating a watermark in the first 
or second embodiment of the present invention, so that the description thereof is omitted. 
(Generation of multiplexed audio data) 
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In the third embodiment, the base function, u(x), fulfills the conditions of the data for 
generating a watermark (generation of base function). 

The other features are the same as those of the generation of multiplexed audio data 
in the first or second embodiment of the present invention, so that the description thereof is 
omitted. 

(Process of embedding a digital watermark) 

The process of embedding a digital watermark in the third embodiment of the present 
invention is the same as the process of embedding a digital watermark in the first or second 
embodiment of the present invention, so that the description thereof is omitted. 

(Other features) 

The other features in the third embodiment of the present invention are the same as 
the other features in the first or second embodiment of the present invention, so that the 
description thereof is omitted. • 

In Fig. 12, the process of the third embodiment is illustrated. 

First, an audio data acquisition unit acquires audio data (Step SI 201). 

Second, a watermark data acquisition unit acquires watermark data (Step SI 202). 

Third, a data generation unit for generating data for a watermark generates data for a 
watermark, in which the value and the slope of the boundary for changing the amplitude 
thereof are always zero, by multiplexing the audio data acquired by Step SI 201 and the data 
for generating a watermark generated by Step SI 202, wherein the result of a predetermined 
summation of multiplexed audio data per predetermined cycle represents the watermark data 
acquired by Step S1202 (Step S1203). 

Fourth, a multiplexed audio data generation unit generates multiplexed audio data 
(Step SI 204) by multiplexing the audio data acquired by Step SI 201 and the data for 
generating a watermark generated by Step SI 203. 

According to the third embodiment of the present invention, since the value and the 
slope of the boundary for changing the amplitude of a function, which is represented by data 
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for generating a watermark, are always zero, even if the amplitude changes, said function 
continues smoothly, so that it becomes possible to prevent generation of high-frequency 
noise. 

Moreover, since one-bit is encoded at one wavelength of data for generating a 
watermark, if the data for generating a watermark has long wavelength, it becomes possible 
to embed a large amount of watermark data effectively. 

(The fourth embodiment) 

The fourth embodiment of the present invention relates to the audio digital watermark 
apparatus according to any one of Claims 1 to 3, wherein said data generation unit for 
generating data for a watermark changes the amplitude of a function represented by said data 
for generating a watermark with respect to each half-cycle so that said result of the 
predetermined summation per. said predetermined cycle represents the watermark data 
acquired by said watermark data acquisition unit. 

As shown in Fig. 13, the audio digital watermark apparatus 1300 of the fourth 
embodiment of the present invention comprises an audio data acquisition unit 1301, a 
watermark data acquisition unit 1302, a data generation unit for generating data for a 
watermark 1303, and a multiplexed audio data generation unit 1304. 

(Audio data acquisition unit) 

The audio data acquisition unit is the same as the audio data acquisition unit in any 
one of the first to third embodiments of the present invention, so that the description thereof 
is omitted. 

(Watermark data acquisition unit) 

The watermark data acquisition unit is the same as the watermark data acquisition 
unit in any one of the first to third embodiments of the present invention, so that the 
description thereof is omitted. 

(Data generation unit for generating data for a watermark) 

The data generation unit for generating data for a watermark data generation unit for 
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generating data for a watermark changes the amplitude of a function represented by said data 
for generating a watermark with respect to each half-cycle so that said result of the 
predetermined summation per said predetermined cycle represents the watermark data 
acquired by said watermark data acquisition unit. 
5 The other features are the same as those of the data generation unit for generating 

data for a watermark in any one of the first to third embodiments of the present invention, so 
that the description thereof is omitted. 

(Multiplexed audio data generation unit) 

The multiplexed audio data generation unit is the same as the multiplexed audio data 
1 0 generation unit in any one of the first to third embodiments of the present invention, so that 
the description thereof is omitted. 

Hereinafter, the fourth embodiment of the present invention will be described by 
using concrete examples. 
1 5 (Acquisition of audio data) 

Acquisition of audio data is the same as the acquisition of audio data in any one of the 
first to third embodiments of the present invention, so that the description thereof is omitted. 

(Acquisition of watermark data) 

Acquisition of watermark data is the same as the acquisition of watermark data in any 
20 one of the first to third embodiments of the present invention, so that the description thereof 
is omitted. 

(Data for generating a watermark: generation of base function) 

Next, a generation method of data for generating a watermark will be described. The 
watermark data is represented by a function in which a function of a basis (hereinafter, 
25 referred to as a base function.) is multiplied by amplitude A. As an example, the following 
function u(t) is described: 
u(t)=sin 3 (2irf-t/R) 

=(3/4) • sin(27r f • t/R) - ( 1 1 A) • sin(3 • 2tt* f • t/R) 
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As shown in Fig. 14, the function value and slope of the above function are zero at 
each half-cycle. Therefore, if the amplitude is changed around the point in which the value 
and slope of the above function are zero at each half-cycle, the function smoothly continues, 
so that it becomes possible to prevent generation of high-frequency noise. 
5 Note that, although a frequency of 3f/R and a frequency of f/R are included in the 

above function, the amplitude of the frequency of 3f/R is 1/3 of the frequency of f/R, so that 
it is inaudible. 

Since the above value of function u(t) is always used, the value per half-cycle is 
computed and a list of the function values is pre-stored in memory. As an example, the 
10 following formula is stored in the memory: u(0),u(l),...,u(R/f/2-l). 
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Moreover, the following value as per latter-half of a cycle is a value in which the 
sign thereof is the inverted sign of the value as per first-half of a cycles* 
u(R/f/2),u(R/f/2+ 1 ), . . . ,u(R/f- 1 ) 



Moreover, as shown in Fig. 15, the values of sample point t of the i-th cycle can be 
derived from the above list of function values by using the following formula: 

(1) u(t)=u (t-(i-l)-R/f), 

(2) t=(i-l)-R/f,(i-l)-R/f+l,..., 

20 (3) (i-l)-R+(R/f/2-l),(i-l)-R+R/f/2,..., 

(4) i-R/f-1. 



(Data for generating a watermark: computation of summation) 

If the sample value of sample point t of the multiplexed audio data with the data for 
25 generating a watermark is w(t), the following formula is formed: w(t)=v(t)+a(t) -u(t) 



If this w(t) is added over a half-cycle of the i-th cycle, the value of a(t) becomes a 
fixed value. If this fixed value is a i? the following formula is formed: Z w(t)= £ v(t)+a; • S 
u(t) 
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Here, £ represents a summation per half-cycle of the i-th cycle of data for 
generating a watermark. 

Moreover, there are the following equations in the description hereinafter for the 
first half-cycle of i-th cycle: 

V H =Ev(t) 

U,=Eu(t) 

an=ai 

Moreover, there are the following equations for the latter half-cycle of i-th cycle: 
V 2i -Ev(t) 
U 2 =£u(t) 
. a 2i =ai 

Vn.V 2 i generally changes each i cycle, and U^U 2 are fixed numbers (in the above example, 
Ui=-U 2 ). These fixed numbers, Ui > U 2 , are also stored in memory. 

(Data for generating a watermark: generation of amplitude) 

Next, the values of a^a^ are fixed so that the absolute value of summation of the 
multiplexed audio data per half-cycle of the data for generating a watermark is fixed, and the 
sign thereof represents a bit-value of the watermark data. Here, the sign for summation of the 
multiplexed audio data per latter half-cycle of the data for generating a watermark is 
reversion of the sign for summation of the multiplexed audio data per first-half cycle of the 
data for generating a watermark. If the bit-value is b(0 or 1), and the absolute value of 
summation of the multiplexed audio data is S, the first-half cycle of i-th cycle is 
M Ew(t)=(-l) b -S=Vn+aii-U|, M and the latter half-cycle of i-th cycle is "i;w(t)=-(-l) b ■ 
S=V 2i +a 2i -U 2 ." 

Therefore, the following formulae are formed for the first-half cycle of the i-th 
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cycle: 



a li ={(-l) b -S-V li }/U 1) and 



for the latter half-cycle of i-th cycle is: 



a 2i ={-(-l) b 'S~V 2i }/U2. 
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Note that, in this example, one cycle represents one bit, so that the value of b 
generally changes at each i. 

(Generation of data for generating a watermark) 



multiplying the base function of the data for generating a watermark with the amplitude a H> 
a 2 i is as follows for the first-half cycle of i-th cycle: 

{{(-l) b "S-V H }AJ|}-u(t), andfor 

the latter half-cycle of the i-th cycle: 



A schematic view of a waveform of the data for generating a watermark 
corresponding to character "C" of the watermark data is illustrated in Fig. 16. Note that, in 
Fig. 16, although the sign for the data for generating a watermark corresponds to the 
20 bit-value, they may be reversible according to the size of V u and V 2 i- The sign corresponding 
to the bit-value is not the sign of amplitude of the data for generating a watermark, but the 
sign for the summation of the multiplexed audio data. 
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The function representing the data for generating a watermark, which is derived by 
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{{-(-l) b -S-V 2i }/U 2 }-u(t) 



(Generation of multiplexed audio data) 
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Therefore, the relationship between the data for generating a watermark and the 



multiplexed audio data w(t) are for the first-half cycle of the i-th cycle: 



w(t)=v(t)+{{(-l) b -S-V H }/U,}-u(t), and for 



the latter half-cycle of i-th cycle: 



w(t)=v(t)+ { {-(- 1 ) b - S- V 2i }/U 2 } ■ u(t). 
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(Other features) 

The other features in the second embodiment of the present invention are the same as 
the other features in the first embodiment of the present invention, so that the description 
thereof is omitted. 

In Fig. 17, the process of the fourth embodiment is illustrated. 

First, an audio data acquisition unit acquires audio data (Step SI 701). 

Second, a watermark data acquisition unit acquires watermark data (Step SI 702). 

Third, a data generation unit for generating data for a watermark changes the 
amplitude of the data for generating a watermark with respect to each half-cycle so that said 
result of the predetermined summation per said predetermined cycle represents the 
watermark data acquired by Step SI 7.02 (Step SI 703). 

Fourth, a multiplexed audio data generation unit generates multiplexed audio data 
(Step SI 704) by multiplexing the audio data acquired by Step SI 701 and the data for 
generating a watermark generated by Step SI 703. 

According to the fourth embodiment of the present invention, the sign for summation 
per predetermined cycle is reversed each time, so that it becomes possible to prevent residual 
of DC offset. 

(The fifth embodiment) 

The fifth embodiment of the present invention relates to the audio digital watermark 
apparatus according to any one of Claims 1 to 4, wherein said result of the predetermined 
summation per said predetermined cycle is a sign for a summation of said multiplexed audio 
data per half-cycle of said data for generating a watermark. 

As shown in Fig. 18, the audio digital watermark apparatus 1800 of the fifth 
embodiment of the present invention comprises an audio data acquisition unit 1801, a 
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watermark data acquisition unit 1802, a data generation unit for generating data for a 
watermark 1803, and a multiplexed audio data generation unit 1804. 
(Audio data acquisition unit) 

The audio data acquisition unit is the same as the audio data acquisition unit in the 
5 fourth embodiment of the present invention, so that the description thereof is omitted. 
(Watermark data acquisition unit) 

The watermark data acquisition unit is the same as the watermark data acquisition 
unit in the fifth embodiment of the present invention, so that the description thereof is 
omitted. 

10 (Data generation unit for generating data for a watermark) 

The data generation unit for generating data for a watermark generates the data for a 
watermark; so that the result of the predetermined summation per predetermined cycle oft 
multiplexed audio data represents the watermark data acquired by the watermark data:, 
acquisition unit. 

15 Here, "the result of the predetermined summation per predetermined cycle" 

corresponds to the sign for the summation of the multiplexed audio data per half-cycle of the 
data for generating a watermark. 

The other features are the same as the data generation unit for generating data for a 
watermark in the fourth embodiment of the present invention, so that the description thereof 
20 is omitted. 

(Multiplexed audio data generation unit) 

The multiplexed audio data generation unit is the same as the multiplexed audio data 
generation unit in the fourth embodiment of the present invention, so that the description 
thereof is omitted. 

25 

Hereinafter, the fifth embodiment of the present invention will be described by using 
concrete examples. 

(Acquisition of audio data) 

Acquisition of audio data is the same as the acquisition of audio data in the fourth 
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embodiment of the present invention, so that the description thereof is omitted. 
(Acquisition of watermark data) 

Acquisition of watermark data is the same as the acquisition of watermark data in the 
fourth embodiment of the present invention, so that the description thereof is omitted. 
(Data for generating a watermark: generation of base function) 

Generation of a base function is the same as the data for generating a watermark 
(generation of base function) in the fourth embodiment of the present invention, so that the 
description thereof is omitted. 

(Data for generating a watermark: computation of summation) 

Computation of summation is the same as the data for generating a watermark 
(computation of summation) in the fourth embodiment of the present invention, so that the 
description thereof is omitted. 

(Data for generating a watermark: generation of amplitude) 

In the description of the data for generating a watermark (generation of amplitude) in 
the fourth embodiment of the present invention, the equation for the first-half cycle of the 
i-th cycle is: 

Ew(t)=(-l) b -S, and for 

the latter-half cycle of the i-th cycle is: 

Ew(t)=-(-l) b -S 

Here, by computing the summation of the multiplexed audio data per half-cycle (per 
first-half cycle or per later-half cycle) of the data for generating a watermark, the sign 
thereof is derived, so that it becomes possible to judge 0 or 1 of each bit of the watermark 
data. Therefore, the amplitude can be generated by the same method described in the fourth 
embodiment of the present invention. 

(Generation of data for generating a watermark) 

Generation of data for generating a watermark is the same as the generation of data 
for generating a watermark in the first or second embodiment of the present invention, so that 
the description thereof is omitted. 
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(Generation of multiplexed audio data) 

Generation of multiplexed audio data is the same as the generation of multiplexed 
audio data in the fourth embodiment of the present invention, so that the description thereof 
is omitted. 

5 (Process of embedding a digital watermark) 

Next, by using the above formula, the process of embedding a digital watermark into 
audio data will be described by referring to Fig. 19. First, the audio data per half-period of 
the data for generating the watermark is inputted to A01, and the summation of the above 
formula is computed and outputted to A03. Meanwhile, the watermark data is inputted to A02, 

10 and a sign of (-l) b or -(-l) b of the above formula is outputted to A03 with respect to each 
cycle of the data for generating a watermark. Therefore, in the first-half cycle, in cases where 
the bit- value is 0, a "+" sign is outputted, and in cases where the bit-value is 1, a sign is 
outputted. Meanwhile, in the latter-half cycle, in cases where the bit-value is 0, a "-" sign is 
outputted, and in cases where the bit-value is 1, a "+" sign is outputted. In A03, by using 

15 these two values, the data for generating a watermark is generated according to the above 
formula, and outputted to A04. In A04, by multiplexing this data for generating a watermark 
and the original audio data, multiplexed audio data with watermark data is generated and 
outputted. 

(Other features) 

20 The other features are the same as the other features in the first embodiment of the 

present invention, so that the description thereof is omitted. 

In Fig. 20, the process of the fifth embodiment is illustrated. 

First, an audio data acquisition unit acquires audio data (Step S2001). 
25 Second, a watermark data acquisition unit acquires watermark data (Step S2002). 

Third, a data generation unit for generating data for a watermark generates a data for 
generating a watermark so that the sign for the summation of multiplexed audio data per 
half-cycle of data for generating a watermark represents the watermark data acquired by Step 
S2002 (Step S2003). 
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Fourth, a multiplexed audio data generation unit generates multiplexed audio data by 
multiplexing the audio data acquired by Step S2001 and the data for generating a watermark 
generated by Step S2003 (Step S2004). 

5 According to the fifth embodiment of the present invention, a sign for the summation 

of multiplexed audio data per half-cycle of data for generating a watermark represents 0 or 1 
of each bit of watermark data, thereby enabling easy detection/decoding of watermark data. 
Moreover, the absolute value of the summation is always fixed and not zero, so that it 
becomes possible to implement a digital watermark which is resistant to the modification of 
10 audio data. 

(The sixth embodiment) 

The sixth embodiment of the present invention relates to the audio digital watermark 
apparatus according to any one of Claims 1 to 4, wherein the result of the predetermined 
15 summation per predetermined cycle is a sign representing the difference between the 
summation of said multiplexed audio data corresponding to the first-half cycle of the data for 
generating a watermark and the summation of said multiplexed audio data corresponding to 
the latter-half cycle of the data for generating a watermark. 

20 As shown in Fig. 21, the audio digital watermark apparatus 2100 of the sixth 

embodiment of the present invention comprises an audio data acquisition unit 2101, a 
watermark data acquisition unit 2102, a data generation unit for generating data for a 
watermark 2103, and a multiplexed audio data generation unit 2104. 
(Audio data acquisition unit) 
25 The audio data acquisition unit is the same as the audio data acquisition unit in the 

fourth embodiment of the present invention, so that the description thereof is omitted. 
(Watermark data acquisition unit) 

The watermark data acquisition unit is the same as the watermark data acquisition 
unit in the fourth embodiment of the present invention, so that the description thereof is 



30 



omitted. 

(Data generation unit for generating data for a watermark) 

The data generation unit for generating data for a watermark correspondingly 
changes the amplitude of data for generating a watermark per half-cycle so that the result of 
the predetermined summation per predetermined cycle represents the watermark data 
acquired by said watermark data acquisition unit. Here, "the result of the predetermined 
summation per predetermined cycle" corresponds to the sign of the difference between the 
summation of said multiplexed audio data corresponding to the first-half cycle of the data for 
generating a watermark and the summation of said multiplexed audio data corresponding to 
the latter-half cycle of the data for generating a watermark. 

(Multiplexed audio data generation unit) 

The multiplexed audio data generation unit is the same as the multiplexed audio data 
generation unit in the fourth embodiment of the present invention, so that the description, , 
thereof is omitted. 

Hereinafter, the sixth embodiment of the present invention will be described by using 
concrete examples. 

(Acquisition of audio data) 

Acquisition of audio data is the same as the acquisition of audio data in the fourth 
embodiment of the present invention, so that the description thereof is omitted. 
(Acquisition of watermark data) 

Acquisition of watermark data is the same as the acquisition of watermark data in the 
fourth embodiment of the present invention, so that the description thereof is omitted. 
(Data for generating a watermark: generation of base function) 

Generation of base function is the same as the data for generating a watermark: 
generation of base function in the fourth embodiment of the present invention, so that the 
description thereof is omitted. 

(Data for generating a watermark: computation of summation) 

Computation of summation is the same as the data for generating a watermark: 
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computation of summation in the fourth embodiment of the present invention, so that the 
description thereof is omitted. 

(Data for generating a watermark: generation of amplitude) 

In the description of data for generating a watermark: generation of amplitude in the 
5 fourth embodiment of the present invention, the equation is as follows for the first-half cycle 
of the i-th cycle: 

Ew(t)=(-l) b -S, and for 

the latter-half cycle of the i-th cycle: 

Ew(t)=-(-l) b -S 

10 

Here, the difference between the summation of said multiplexed audio data corresponding to 
the first-half cycle of the data for generating a watermark and the summation of said 
multiplexed audio data corresponding to the later-half cycle of the data for generating a 
watermark is: (-l) b -2S. By the sign thereof, it becomes possible to judge 0 or 1 of each bit 
15 of the watermark data. Therefore, the amplitude can be generated by the same method 
described in the fourth embodiment of the present invention. 
(Generation of data for generating a watermark) 

Generation of data for generating a watermark is the same as the generation of data 
for generating a watermark in the fourth embodiment of the present invention, so that the 
20 description thereof is omitted. 

(Generation of multiplexed audio data) 

Generation of multiplexed audio data is the same as the generation of multiplexed 
audio data in the fourth embodiment of the present invention, so that the description thereof 
is omitted. 

25 (Process of embedding a digital watermark) 

Process of embedding a digital watermark is the same as the process of embedding a 
digital watermark in the fifth embodiment of the present invention, so that the description 
thereof is omitted. 

(Other features) 
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The other features are the same as the other features in the first embodiment of the 
present invention, so that the description thereof is omitted. 

In Fig. 22, the process of the sixth embodiment is illustrated. 

First, an audio data acquisition unit acquires audio data (Step S2201). 

Second, a watermark data acquisition unit acquires watermark data (Step S2202). 

Third, a data generation unit for generating data for a watermark generates data for 
generating a watermark so that the sign representing the difference between the summation 
of said multiplexed audio data corresponding to the first-half cycle of the data for generating 
a watermark and the summation of said multiplexed audio data corresponding to the 
later-half cycle of the data for generating a watermark represents the watermark data 
acquired by the Step S2202 (Step S2003). 

Fourth, a multiplexed audio data generation unit generates multiplexed audio data by 
multiplexing the audio data acquired by Step S2201 and the data for generating a watermark 
generated by Step S2203 (Step S2204). 

According to the sixth embodiment of the present invention, the sign representing the 
difference between the summation of said multiplexed audio data corresponding to the 
first-half cycle of the data for generating a watermark and the summation of said multiplexed 
audio data corresponding to the later-half cycle of the data for generating a watermark 
represents 0 or 1 of each bit of watermark data, thereby enabling a robust digital watermark 
without interference of DC offset. 

(The seventh embodiment) 

The seventh embodiment of the present invention relates to an audio digital 
watermark decoding apparatus for decoding watermark data recorded on an audio recording 
medium, which comprises: 

a multiplexed audio data acquisition unit, which acquires multiplexed 
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audio data, 

a summation computation unit, which computes the result of a predetermined 
summation of multiplexed audio data per said predetermined cycle, wherein said multiplexed 
audio data is acquired by the multiplexed audio data acquisition unit, and 

a watermark data decoding unit, which decodes said watermark data based on said 
result of a predetermined summation computed by said summation computation unit. 

As shown in Fig. 23, the audio digital watermark decoding apparatus 2300 of the 
seventh embodiment of the present invention comprises a multiplexed audio data acquisition 
unit 2301, a summation computation unit 2302, and a watermark data decoding unit 2303. 

(Multiplexed audio data acquisition unit) 

The multiplexed audio data acquisition unit acquires multiplexed audio data. 
(Summation computation unit) 

The summation computation unit computes a result of predetermined summation per 
predetermined cycle of multiplexed audio data acquired by the multiplexed audio data 
acquisition unit. 

Here, the "result of predetermined summation of multiplexed audio data per 
predetermined cycle" corresponds to the result of predetermined summation of data for 
generating a watermark of multiplexed audio data per predetermined cycle. The 
"predetermined cycle" corresponds to a half-cycle, 1-cycle, 1.5-cycle, 2-cycle, 2.5-cycle, 
3-cycle, and so on. The "predetermined summation" corresponds to the summation of a 
half-cycle and the summation of one cycle, etc. The "result of predetermined summation" 
corresponds to the summation per half-cycle, of one cycle, a sign for summation, and a sign 
representing difference between summations, etc. 

(Watermark data decoding unit) 

The watermark data decoding unit decodes the watermark data based on the result of a 
predetermined summation computed by said summation computation unit. 

Hereinafter, the seventh embodiment of the present invention will be described by 
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using concrete examples. 

(Acquisition of multiplexed audio data) 

In the acquisition of multiplexed audio data in the seventh embodiment of the present 
invention, for example, the multiplexed audio data generated in the first embodiment w(t) is 
acquired: w(t)=v(t)+{(-l) b -S-Vi} -u(t)/U. 

Here, symbols represent the same meaning as that in the first embodiment of the 
present invention. 

(Computation of summation) 

As described in the first embodiment of the present invention, the summation of the 
multiplexed audio data per 1 cycle of the i-th cycle is: 
£w(t)=(-l) b -S 
=+S (b=0) 
=-S (b=l) 

(Decoding watermark data) 

As the above formula, the difference of each bit-value is represented by the difference 
of the sign of the summation of the multiplexed audio data, so that it becomes possible to 
derive the summation of one cycle, to judge 0 or 1 of each bit of watermark data, and to 
decode. 

(Detection process of a watermark) 

Fig. 24 is a block diagram illustrating the detection process of watermark data. In Fig. 
24, each sample value of the multiplexed audio data with a watermark per one cycle of the 
data for generating a watermark is inputted to B01; the summation per 1 cycle is computed; 
and the sign thereof is outputted to B02. In B02, 0 or 1 is selected according to the sign, and 
is outputted as watermark data. 

(Other features) 

The other features are the same as the other features in the first embodiment of the 
present invention, so that the description thereof is omitted. 
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In Fig. 25, the process of the seventh embodiment is illustrated. 

First, a multiplexed audio data acquisition unit acquires multiplexed audio data in 
which data for generating a watermark and audio data are multiplexed (Step S2501). 
5 Second, a summation computation unit computes the result of a predetermined 

summation of multiplexed audio data per predetermined cycle, wherein the multiplexed audio 
data is acquired by Step S2501 (Step S2502). 

Third, a watermark data decoding unit decodes the watermark data based on the result 
of a predetermined summation computed by Step S2502 (Step S2503). 

10 

According to the seventh embodiment of the present invention, it becomes possible to 
judge 0 or 1 of each bit of watermark data by the result of a predetermined summation of 
multiplexed audio data per predetermined cycle of data for generating a watermark, thereby 
enabling easy detection/decoding of watermark data. Moreover, said result of a 
15 predetermined summation is resistant to modification of audio data, thereby implementing a 
robust digital watermark. 

(The eighth embodiment) 

The eighth embodiment of the present invention relates to the audio digital watermark 
20 decoding apparatus according to Claim 7, which decodes watermark data based on the sign 
for the summation of the multiplexed audio data over a period of half-cycle of the data for 
generating a watermark. 

As shown in Fig. 26, the audio digital watermark decoding apparatus 2600 of the 
25 eighth embodiment of the present invention comprises a multiplexed audio data acquisition 
unit 2601, a summation computation unit 2602, and a watermark data decoding unit 2603. 
(Multiplexed audio data acquisition unit) 

The multiplexed audio data acquisition unit acquires multiplexed audio data. 
(Summation computation unit) 
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The summation computation unit computes the sign of the summation over half-cycle 
of the data for generating a watermark. 
(Watermark data decoding unit) 

The watermark data decoding unit decodes the watermark data based on the sign for 
5 the summation computed by said summation computation unit. 

Hereinafter, the eighth embodiment of the present invention will be described by 
using concrete examples. 

(Acquisition of multiplexed audio data) 
10 In the acquisition of multiplexed audio data in the eighth embodiment of the present 

invention, for example, the multiplexed audio data generated in the fifth embodiment w(t) is 
acquired, for the first-half cycle of the i-th cycle, as follows: 

w(t)=v(t)+{{(-l) b -S-V li }/U 1 }-u(t),andfor ■< 
the latter-half cycle of the i-th cycle: 
1 5 w(t)=v(t)+ { {-(- 1 ) b • S-V 2i } /U 2 } • u(t) 

Here, the symbols represent the same meaning as those in the fifth embodiment of the present 
invention. 

2 0 (Computation of summation) 

As described in the fifth embodiment of the present invention, the summation for the 
multiplexed audio data per first-half cycle and last-half cycle of the i-th cycle are, for the 
first-half cycle of the i-th cycle, as follows: 
EwW-VH+au-U,, 
25 =+S(b=0), 

=-S (b=l),and for 

the latter-half cycle of the i-th cycle: 

Ew(t)=V 2i -fa 2i -U 2 

=-S (b=0) 
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=+S (b=l) 

(Decoding watermark data) 

As the above formula, the difference of each bit-value is represented by the difference 
5 of the sign for the summation of the multiplexed audio data, so that it becomes possible to 
derive the summation per first-half cycle or per latter-half cycle, to judge 0 or 1 of each bit 
of watermark data, and to decode. 

(Detection process of a watermark) 

Fig. 27 is a block diagram illustrating the detection process of watermark data. In Fig. 
10 27, each sample value of the multiplexed audio data with a watermark per half-cycle (per 
first-half cycle or per latter-half cycle) of the data for generating a watermark is inputted to 
B01, the summation per half-cycle is computed, and the sign thereof is outputted to B02. In 
B02, 0 or 1 is selected according to the sign, and is outputted as watermark data. j- 

(Other features) 

1 5 The other features are the same as the other features in the first embodiment of the 

present invention, so that the description thereof is omitted. 

In Fig. 28, the process of the eighth embodiment is illustrated. 

First, a multiplexed audio data acquisition unit acquires multiplexed audio data in 
20 which data for generating a watermark and audio data are multiplexed (Step S2801). 

Second, a summation computation unit computes the result of a predetermined 
summation of multiplexed audio data per predetermined cycle, wherein the multiplexed audio 
data is acquired by Step S2801 (Step S2802). 

Third, a watermark data decoding unit judges the bit-value from the sign of a 
25 summation computed by Step S2802 and decodes it (Step S2803). 

According to the eighth embodiment of the present invention, it becomes possible to 
judge 0 or 1 of each bit of watermark data by the sign for the summation of the multiplexed 
audio data over a period of a half-cycle of the data for generating a watermark, thereby 
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enabling easy detection/decoding of watermark data. Moreover, the absolute value of said 
predetermined summation is always a fixed value different from zero, thereby implementing 
a robust digital watermark resistant to modification of audio data. 

(The ninth embodiment) 

The ninth embodiment of the present invention relates to the audio digital watermark 
decoding apparatus according to Claim 7, which decodes watermark data based on the sign of 
the difference between the summation of said multiplexed audio data over a period of a 
half-cycle, the first-half of one cycle, and the summation of said multiplexed audio data over 
a period of a half-cycle, the latter-half thereof. 

As shown in Fig. 29, the audio digital watermark decoding apparatus 2900 of the 
ninth embodiment of the present invention comprises a multiplexed audio data acquisition*, 
unit 2901, a summation computation unit 2902, and a watermark data decoding unit 2903. 

(Multiplexed audio data acquisition unit) 

The multiplexed audio data acquisition unit acquires multiplexed audio data. 
(Summation computation unit) 

The summation computation unit computes the sign of a difference between the 
summation of said multiplexed audio data over a period of a half-cycle, the first-half of one 
cycle, and a summation of said multiplexed audio data over a period of a half-cycle, the 
later-half thereof. 

(Watermark data decoding unit) 
The watermark data decoding unit decodes the watermark data based on the sign representing 
the difference of the summation computed by said summation computation unit. 

Hereinafter, the ninth embodiment of the present invention will be described by using 
concrete examples. 

(Acquisition of multiplexed audio data) 

In the acquisition of multiplexed audio data in the ninth embodiment of the present 
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invention, for example, the multiplexed audio data generated in the sixth embodiment, w(t), 
is acquired as follows for the first-half cycle of the i-th cycle: 

w(t)=v(t)+{{(-l) b -S-V li }/U,}-u(t), and for 

the latter-half cycle of the i-th cycle: 
5 w(t)=v(t)+{{-(-l) b -S-V 2i }/U 2 }-u(t). 



Here, the symbols represent the same meaning as those in the sixth embodiment of the 
present invention. 

1 0 (Computation of summation) 

As described in the sixth embodiment of the present invention, the summation of the 
multiplexed audio data per the first-half cycle and the latter-half cycle of the i-th cycle are 
for the first-half-cycle of the i-th cycle: 
£w(t)=+S (b=0) 
15 =-S(b=l), and for 

the latter-half cycle of the i-th cycle: 
£w(t)=-S (b=0) 
=+S (b=l) 

20 (Decoding watermark data) 

As the above formula, the difference of each bit-value is represented by the 
difference of the sign of the above formula. 

In deriving the summation per the latter-half cycle from the summation of the 
first-half cycle, there are as follows: 

25 

+2S (b=0) 
-2S(b=l) 



Here, by the above sign, it becomes possible to judge the bit-value; thus, DC offset can be 
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cancelled. In the ninth embodiment of the present invention, it is implemented to eliminate 
the interference of DC offset. 

(Detection process of a watermark) 
5 Fig. 30 is a block diagram illustrating the detection process of watermark data. In Fig. 

27, the multiplexed audio data with watermark data per half-cycle of the data for generating a 
watermark is inputted to B01, the difference between the summation per half-cycle and that 
per latter-half cycle is computed, and the sign thereof is outputted to B02. In B02, 0 or 1 is 
selected according to the sign, and is outputted as watermark data. 
10 (Other features) 

The other features are the same as the other features in the first embodiment of the 
present invention, so that the description thereof is omitted. 

In Fig. 31, the process of the ninth embodiment is illustrated. 

15 First, a multiplexed audio data acquisition unit acquires multiplexed audio data in 

which data for generating a watermark and audio data are multiplexed (Step S3 101). Second, 
a summation computation unit computes the sign of the difference between the summation of 
said multiplexed audio data over a period of a half-cycle, the first-half of one cycle, and the 
summation of said multiplexed audio data over a period of a half-cycle, the latter-half thereof, 

20 wherein the multiplexed audio data is acquired by Step S3 101 (Step S3 102). 

Third, a watermark data decoding unit decodes the watermark data so that the sign of 
the value computed by Step S3 102 represents the bit-value of the watermark data (Step 
S3103). 

25 According to the ninth embodiment of the present invention, 0 or 1 of each bit of 

watermark data is judged from the sign of the difference between the summation of said 
multiplexed audio data over a period of a half-cycle, the first-half of one cycle, and the 
summation of said multiplexed audio data over a period of a half-cycle, the latter-half thereof, 
so that DC offset is cancelled. Therefore, it becomes possible to implement a digital 
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watermark which is resistant to distortion. 

Industrial Applicability 

According to the present invention, since the data of inaudible low frequency is used 
5 as data for generating a watermark, even if amplitude of data for generating a watermark is 
wide, it becomes possible to implement a robust digital watermark without the degradation of 
sound quality of the original audio data. 

Moreover, since one bit is encoded at one wavelength of data for generating a 
watermark, if the data for generating a watermark has a long wavelength, it becomes possible 

10 to embed a large amount of watermark data effectively. 

Moreover, not the data for generating a watermark, but the sign of the result of a 
predetermined summation per predetermined cycle of multiplexed audio data, in which the 
data for generating a watermark and the original audio data are multiplexed, corresponds to t . 
the bit-value of watermark data, thereby enabling easy detection/decoding. 

15 Moreover, the above process of embedding a watermark is reversible, so that it is 

possible to perfectly recover if there is time-series data of amplitude of the data for 
generating watermark which has been used in embedding the watermark data. Moreover, 
even if after watermark data has been embedded, the other watermark data is embedded by 
another person; it is possible to extract each watermark data and recover the original audio 

20 data. Thus, the present invention enables to embedding of a watermark several times over. 
Therefore, for example, it becomes possible to embed a unique ID for a content provider for 
the purpose of preventing fraudulent secondary distribution while protecting copyright 
thereof after a copyright holder embeds information on the copyright. 

Moreover, it is impossible to recover the original state of the data without the 

25 time-series data of amplitude of the data for generating watermark which has been used in 
embedding the watermark data, so that no one other than the person who owns said 
time-series data of first embedding of the watermark data can recover the original audio data. 
Therefore, by using the above aspect of the present invention, it is possible to establish a 
digital watermark system, which is highly resistant to falsification. 



